Multilinear and nonlinear generalizations of partial least squares: an overview of recent advances
نویسندگان
چکیده
Partial Least Squares (PLS) is an efficient multivariate statistical regression technique that has proven to be particularly useful for analysis of highly collinear data. To predict response variables Y from independent variables X, PLS attempts to find a set of common orthogonal latent variables by projecting both X and Y onto a new subspace respectively. As an increasing interest in multiway analysis, the extension to multilinear regression model are also developed with the aim to analyzing two multidimensional tensor data. In this article, we overview the PLS related methods including linear, multilinear and nonlinear variants and discuss the strength of the algorithms. Since Canonical Correlation Analysis (CCA) is another similar technique with aim to extract the most correlated latent components between two datasets, we also briefly discuss the extension of CCA to tensor space. Finally, several examples are given to compare these methods with respect to the regression and classification performance.
منابع مشابه
Partial least squares for IS researchers: an overview and presentation of recent advances using the PLS approach
متن کامل
Tensor Decompositions: A New Concept in Brain Data Analysis?
Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component Analysis (ICA), Nonnegative Matrix and Tensor Factorization (NMF/NTF), Smooth Component Analysis (SmoCA) and Sparse Component Analysis (SCA). Moreover, tensor decompositions hav...
متن کاملSuperlinearly convergent exact penalty projected structured Hessian updating schemes for constrained nonlinear least squares: asymptotic analysis
We present a structured algorithm for solving constrained nonlinear least squares problems, and establish its local two-step Q-superlinear convergence. The approach is based on an adaptive structured scheme due to Mahdavi-Amiri and Bartels of the exact penalty method of Coleman and Conn for nonlinearly constrained optimization problems. The structured adaptation also makes use of the ideas of N...
متن کاملLeast Squares Methods for Models Including Ordinary and Partial Differential Equations
This contribution gives a brief overview on nonlinear constrained least squares methods. The focus is on data fitting problems in which the models include ordinary or partial differential equations.
متن کاملGeneralizations of the total least squares problem
Recent advances in total least squares approaches for solving various errorsin-variables modeling problems are reviewed, with emphasis on the following generalizations: 1. the use of weighted norms as a measure of the data perturbation size, capturing prior knowledge about uncertainty in the data; 2. the addition of constraints on the perturbation to preserve the structure of the data matrix, m...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Wiley Interdisc. Rew.: Data Mining and Knowledge Discovery
دوره 4 شماره
صفحات -
تاریخ انتشار 2014